• Article  

      Characterizing crawler behavior from web server access logs 

      Dikaiakos, Marios D.; Stassopoulou, Athena; Papageorgiou, Loizos (2003)
      In this paper, we present a study of crawler behavior based on Web-server access logs. To this end, we use logs from five different academic sites in three countries. Based on these logs, we analyze the activity of different ...